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No studies of Words Their Way ™ that fall within the scope of the Beginning Reading review protocol 
meet What Works Clearinghouse (WWC) evidence standards. The lack of studies meeting WWC evidence 
standards means that, at this time, the WWC is unable to draw any conclusions based on research 
about the effectiveness or ineffectiveness of Words Their Way™ on beginning readers. Additional 
research is needed to determine the effectiveness or ineffectiveness of this intervention. 

Program Description 1 

Words Their Way™ is an approach to phonics, vocabulary, and spelling instruction for students in kindergarten 
through high school. The program can be implemented as a core or supplemental curriculum and aims to provide 
a practical way to study words with students. The purpose of word study (which involves examining, manipulating, 
comparing, and categorizing words) is to reveal logic and consistencies within written language and to help students 
achieve mastery in recognizing, spelling, and defining specific words. 

The program’s main textbook, Words Their Way: Word Study for Phonics, Vocabulary, and Spelling Instruction, 2 
focuses on the five stages of spelling development and contains more than 250 ready-to-use activities. 

The five developmental stages include the emergent stage (Pre-K to middle of first grade), the letter name-alphabetic 
stage (kindergarten to middle of second grade), the within word pattern stage (first grade to middle of fourth 
grade), the syllables and affixes stage (third grade to eighth grade), and the derivational relations stage (fifth grade 
to twelfth grade). Activities in each chapter include concept categorizing, word sorting, and games. Teachers use 
these activities to focus students’ attention on critical features of words including sound, pattern, and meaning. 
Students examine words to discover the regularities, conventions, and patterns in relationships between speech 
sounds and corresponding written words. 

Words Their Way™ also includes five additional stage-specific volumes, providing a complete curriculum of word 
building and sorting activities and detailed instructions for the teacher. Other related volumes are designed to meet 
the needs of English language learners and students in the intermediate and secondary levels. 

This review of Words Their Way™ for the Beginning Reading topic area focuses on reading outcomes of students 
in grades K-3. 

Research 3 

The WWC identified 29 studies of Words Their Way™ for beginning readers that were published or released 
between 1983 and 2012. 

One study is within the scope of the Beginning Reading review protocol but does not meet WWC evidence standards. 
The study uses a quasi-experimental design but does not establish that the comparison group was comparable to 
the intervention group prior to the start of the intervention. 


Words Their Way™ February 201 3 


Page 1 






WWC Intervention Report 


Fifteen studies are out of the scope of the Beginning Reading review protocol because they have an ineligible 
study design. 

• Eleven studies are literature reviews or meta-analyses. 

• Four studies do not use a comparison group design, a regression discontinuity design, or a single-case design. 
Thirteen studies are out of the scope of the Beginning Reading review protocol for reasons other than study design. 

• Eleven studies do not use a sample aligned with the protocol— the sample does not fall within the Beginning 
Reading grade range of K-3. 

• Two studies include fewer than 50% general education students. 
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Endnotes 

1 The descriptive information for this program was obtained from publicly available sources: the program’s website (http://www.pearsonschool. 
com/wtw, downloaded September 2012) and Bear et al. (2012). The WWC requests distributors to review the program description 
sections for accuracy from their perspective. The program description was provided to the distributor in September 2012, and the 
WWC incorporated feedback from the distributor. Further verification of the accuracy of the descriptive information for this program 
is beyond the scope of this review. The literature search reflects documents publicly available by April 2012. 

2 Bear, D., Invernizzi, M., Templeton, S., & Johnston, F. (201 2). Words Their Way: Word study for phonics, vocabulary, and spelling 
instruction (5th ed,). Upper Saddle River, NJ: Pearson Education, Inc. 

3 The studies in this report were reviewed using the Evidence Standards from the WWC Procedures and Standards Flandbook 
(version 2.1), along with those described in the Beginning Reading review protocol (version 2.1). The evidence presented in this 
report is based on available research. Findings and conclusions may change as new research becomes available. 

Recommended Citation 

U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2013, February). 
Beginning Reading intervention report: Words Their Way™. Retrieved from http://whatworks.ed.gov. 


Page 6 


WWC Intervention Report 


Glossary of Terms 

Attrition 

Clustering adjustment 
Confounding factor 

Design 
Domain 
Effect size 

Eligibility 

Equivalence 

Extent of evidence 

Improvement index 

Multiple comparison 
adjustment 

Quasi-experimental 
design (QED) 

Randomized controlled 
trial (RCT) 

Rating of effectiveness 

Single-case design 
Standard deviation 


Statistical significance 


Substantively important 


Attrition occurs when an outcome variable is not available for all participants initially assigned 
to the intervention and comparison groups. The WWC considers the total attrition rate and 
the difference in attrition rates across groups within a study. 

If intervention assignment is made at a cluster level and the analysis is conducted at the student 
level, the WWC will adjust the statistical significance to account for this mismatch, if necessary. 

A confounding factor is a component of a study that is completely aligned with one of the 
study conditions, making it impossible to separate how much of the observed effect was 
due to the intervention and how much was due to the factor. 

The design of a study is the method by which intervention and comparison groups were assigned. 
A domain is a group of closely related outcomes. 

The effect size is a measure of the magnitude of an effect. The WWC uses a standardized 
measure to facilitate comparisons across studies and outcomes. 

A study is eligible for review and inclusion in this report if it falls within the scope of the 
review protocol and uses either an experimental or matched comparison group design. 

A demonstration that the analysis sample groups are similar on observed characteristics 
defined in the review area protocol. 

An indication of how much evidence supports the findings. The criteria for the extent of 
evidence levels are given in the WWC Procedures and Standards Handbook (version 2.1). 

Along a percentile distribution of students, the improvement index represents the gain 
or loss of the average student due to the intervention. As the average student starts at 
the 50th percentile, the measure ranges from -50 to +50. 

When a study includes multiple outcomes or comparison groups, the WWC will adjust 
the statistical significance to account for the multiple comparisons, if necessary. 

A quasi-experimental design (QED) is a research design in which subjects are assigned 
to intervention and comparison groups through a process that is not random. 

A randomized controlled trial (RCT) is an experiment in which investigators randomly assign 
eligible participants into intervention and comparison groups. 

The WWC rates the effects of an intervention in each domain based on the quality of the research 
design and the magnitude, statistical significance, and consistency in findings. The criteria for the 
ratings of effectiveness are given in the WWC Procedures and Standards Handbook (version 2.1). 

A research approach in which an outcome variable is measured repeatedly within and 
across different conditions that are defined by the presence or absence of an intervention. 

The standard deviation of a measure shows how much variation exists across observations 
in the sample. A low standard deviation indicates that the observations in the sample tend 
to be very close to the mean; a high standard deviation indicates that the observations in 
the sample tend to be spread out over a large range of values. 

Statistical significance is the probability that the difference between groups is a result of 
chance rather than a real difference between the groups. The WWC labels a finding statistically 
significant if the likelihood that the difference is due to chance is less than 5% (p < 0.05). 

A substantively important finding is one that has an effect size of 0.25 or greater, regardless 
of statistical significance. 


Please see the WWC Procedures and Standards Handbook (version 2.1) for additional details. 
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